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Abstract 

We present results on the enumeration of crossings and nestings for matchings and set par- 
titions. Using a bijection between partitions and vacillating tableaux, we show that if we fix 
the sets of minimal block elements and maximal block elements, the crossing number and the 
nesting number of partitions have a symmetric joint distribution. It follows that the crossing 
numbers and the nesting numbers are distributed symmetrically over all partitions of [n] , as well 
as over all matchings on [2n] . As a corollary, the number of fc-noncrossing partitions is equal to 
the number of fc-nonnesting partitions. The same is also true for matchings. An application is 
given to the enumeration of matchings with no fc-crossing (or with no fc-nesting). 

Mathematics Subject Classification. Primary 05A18, secondary 05E10, 05A15. 



1 



Key words and phrases. Crossing, nesting, partition, vacillating tableau. 

1 Introduction 

A (complete) matching on [2n] = {1, 2, . . . , 2n} is a partition of [2n] of type (2, 2, . . . , 2). It can 
be represented by listing its n blocks, as (i2,j2), ■ • • , (in,jn)} where i r < j r for 1 < r < n. 

Two blocks (also called arcs) (i r ,jr) and (i s ,js) form a crossing if i r < i s < j r < j s ; they form 
a nesting if i r < i s < j s < j r . It is well-known that the number of matchings on [2n] with no 
crossings (or with no nestings) is given by the n-th Catalan number 



See |25l Exercise 6.19] for many combinatorial interpretations of Catalan numbers, where item (o) 
is for noncrossing matchings, and item (ww) can be viewed as nonnesting matchings, in which the 
blocks of the matching are the columns of the standard Young tableaux of shape (n, n). Nonnesting 
matchings are also one of the items of |26j . 

Let k > 2 be an integer. A k-crossing of a matching M is a set of k arcs (i ri ,j ri ), (v 2 > Jr 2 )> • • • > 
(i rk , j rk ) of M such that i ri < i r2 < ■ ■ ■ < i Tk < j n < j r2 < ■ ■ ■ < j Tk . A matching without any 
fc-crossing is a k-noncrossing matching. Similarly, a fc-nesting is a set of k arcs (Vi> jri)j (^2)^2)1 
. . . , (i rk , j rk ) of M such that i ri < i r2 < ■ ■ ■ < i r - k < j Tk < ■ ■ ■ < j r2 < j n . A matching without 
any fc-nesting is a k-nonnesting matching. 

Enumeration on crossings/nestings of matchings has been studied for the cases k = 2 and k = 3. 
For k = 2, in addition to the above results on Catalan numbers, the distribution of the number 
of 2-crossings has been studied by Touchard 29 j, and later more explicitly by Riordan who 
gave a generating function. M. de Sainte-Catherine jSJ proved that 2-crossings and 2-nestings are 
identically distributed over all matchings of [2n], i.e., the number of matchings with r 2-crossings 
is equal to the number of matchings with r 2-nestings. 

The enumeration of 3-nonnesting matchings was first studied by Gouyou-Beauschamps 
in which he gave a bijection between involutions with no decreasing sequence of length 6 and 
pairs of noncrossing Dyck left factors by a recursive construction. His bijection is essentially a 
correspondence between 3-nonnesting matchings and pairs of noncrossing Dyck paths, where a 
matching can also be considered as a fixed-point-free involution. We observed that the number of 
3-noncrossing matchings also equals the number of pairs of noncrossing Dyck paths, and a one-to- 
one correspondence between 3-noncrossing matchings and pairs of noncrossing Dyck paths can be 
built recursively. 

2 partially supported by the 973 Project on Mathematical Mechanization, the National Science Foundation, the 
Ministry of Education and the Ministry of Science and Technology of China. 
6 Partially supported by NSF grant #DMS-9988459. 

8 Partially supported by NSF grant #DMS-0245526 and a Sloan Fellowship. 
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In this paper, we extend the above results. Let cr(M) be maximal i such that M has an i- 
crossing, and ne(M) the maximal j such that M has a j-nesting. Denoted by f n {i,j) the number 
of matchings M on [2n] with cr(M) = z and ne(M) = j. We shall prove that f n (hj) = fn{j,i)- As 
a corollary, the number of matchings on [2n] with cr(M) = equals the number of matchings M 
on [2ra] with ne(M) = k. 

Our construction applies to a more general structure, viz., partitions of a set. Given a partition 
P of [n], denoted by P G Tl n , we represent P by a graph on the vertex set [n] whose edge set consists 
of arcs connecting the elements of each block in numerical order. Such an edge set is called the 
standard representation of the partition P. For example, the standard representation of 1457-26-3 
is {(1,4), (4,5), (5,7), (2,6)}. Here we always write an arc e as a pair with i < j, and say that 
i is the lefthand endpoint of e and j is the righthand endpoint of e. 

Let k > 2 and P G Ii n . Define a k-crossing of P as a fc-subset (h,ji), fa, 32), • • • , {h,jk) of 
the arcs in the standard representation of P such that i\ < 12 < ■ ■ ■ < ik < 3i < 32 < ■ ■ ■ < jk- 
Let cr(P) be the maximal k such that P has a fc-crossing. Similarly, define a k-nesting of P as a 
fc-subset ji), («2, J2), • • • , (hi 3k) °f the set of arcs in the standard representation of P such that 
i\ < 12 < ■ ■ ■ < %k < jk < ■ • • < 32 < ji, and ne(P) the maximal j such that P has a j-nesting. Note 
that when restricted to complete matchings, these definitions agree with the ones given before. 

Let g n (hj) be the number of partitions P of [n] with cr(P) = i and ne(P) = j. We shall 
prove that g n (hj) = 9n{i,i), for all i,j and n. In fact, our result is much stronger. We present a 
generalization which implies the symmetric distribution of cr(P) and ne(P) over all partitions in 
LT n , as well over all complete matchings on [2n\. 

To state the main result, we need some notation. Given P G II ra , define 

min(P) = {minimal block elements of P}, 
max(P) = {maximal block elements of P}. 

For example, for P = 135-26-4, min(P) = {1, 2, 4} and max(P) = {4, 5, 6}. The pair (min(P), max(P)) 
encodes some useful information about the partition P. For example, the number of blocks of 
P is |min(P)| = |max(P)|; number of singleton blocks is | min(P) n max(P)|; P is a (partial) 
matching if and only if min(P) U max(P) = [n], and P is a complete matching if in addition, 
min(P) n max(P) = 0. 

Fix S,TC [n] with \S\ = |T|. Let P n {S,T) be the set {P G LT n : min(P) = ,S,max(P) = T}, 
and f n ,S,T(i,j) be the cardinality of the set {P G P n (S,T) : cr(P) = i,ne(P) = j}. 

Theorem 1. 



fn,S,T(i,j) = fn,S,T 



(3,i). 



(1) 



In other words, 




x 




(2) 



P£P n (S,T) 



P£P n (S,T) 



3 



That is, the statistics cr(P) and ne(P) have a symmetric joint distribution over each set P n (S,T). 
□ 

Summing over all pairs (S,T) in (^Q), we get 

9n(hj) = 9n(j,i)- (3) 

We say that a partition P is k-noncrossing if cr(P) < fc. It is k-nonnesting if ne(P) < fc. Let 
NCNfcj(n) be the number of partitions of [n] that are /c-noncrossing and /-nonnesting. Summing 
over 1 < i < k and 1 < j < I in © , we get the following corollary. 

Corollary 2. NCN fei j(n) = NCN /jfc (n). □ 

Letting / > n, Corollary [2 becomes the following result. 

Corollary 3. NC/%(n) = NN^(n), where NCfc(n) is the number of £>noncrossing partitions of [n], 
and NNfc(n) is the number of /c-nonnesting partitions of [n]. □ 

Theorem ^ also applies to complete matchings. A partition P of [2n] is a complete matching 
if and only if | min(P)| = | max(P)| = n and min(P) n max(P) = 0. (It follows that min(P) U 
max(P) = [2n].) Restricting Theoremnto disjoint pairs (S,T) of [2n] with | *S' | = \T\ = n, we get 
the following result on the crossing and nesting number of complete matchings. 

Corollary 4. Let M be a matching on [2n]. 

1. The statistics cr(M) and ne(M) have a symmetric joint distribution over P2 n (S,T), where 
|5| = \T\ = n, and S, T are disjoint. 

2- fn(hj) = fn(j,i) where f n {hj) is the number of matchings on [2n] with cr(M) = i and 
ne(M) = j. 

3. The number of matchings on [2n] that are A:-noncrossing and /-nonnesting is equal to the number 
of matchings on [2n] that are /-noncrossing and /c-nonnesting. 

4. The number of /c-noncrossing matchings on [2n] is equal to the number of /c-nonnesting matchings 
on [2n]. 

□ 

The paper is arranged as follows. In Section 2 we introduce the concept of vacillating tableau 
of general shape, and give a bijective proof for the number of vacillating tableaux of shape A and 
length 2n. In Section 3 we apply the bijection of Section 2 to vacillating tableaux of empty shape, 
and characterize crossings and nestings of a partition by the corresponding vacillating tableau. 
The involution on the set of vacillating tableaux defined by taking the conjugate to each shape 
leads to an involution on partitions which exchanges the statistics cr(P) and ne(P) while preserves 
min(P) and max(P), thus proving Theorem^ Then we modify the bijection between partitions and 
vacillating tableaux by taking isolated points into consideration, and give an analogous result on the 
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enhanced crossing number and nesting number. This is the content of Section 4. Finally in Section 
5 we restrict our bijection to the set of complete matchings and oscillating tableaux, and study the 
enumeration of /c-noncrossing matchings. In particular, we construct bijections from fc-noncrossing 
matchings for k = 2 or 3 to Dyck paths and pairs of noncrossing Dyck paths, respectively, and 
present the generating function for the number of &-noncrossing matchings. 

2 A Bijection between Set Partitions and Vacillating Tableaux 

Let Y be Young's lattice, that is, the set of all partitions of all integers n G N ordered component- 
wise, i.e., (fii,fi2, ■ ■ ■ ) < (Ai, A2, . . . , ) if ^ < Xi for all i. We write A h k or | A| = k if ^ Aj = k. A 
vacillating tableau is a walk on the Hasse diagram of Young's lattice subject to certain conditions. 
The main tool in our proof of Theorem ^ is a bijection between the set of set partitions and the 
set of vacillating tableaux of empty shape 0. 

Definition 1. A vacillating tableau V 2n of shape A and length 2n is a sequence A , A 1 , ... , A 2n of 
integer partitions such that (i) A = 0, and A 2n = A, (ii) A 2j+1 is obtained from X 2 ' 1 by doing nothing 
(i.e., A 2i+1 = A 2i ) or deleting a square, and (hi) A 2j is obtained from A 2i 1 by doing nothing or 
adding a square. 

In other words, a vacillating tableau of shape A is a walk on the Hasse diagram of Young's 
lattice from to A where each step consists of either (i) doing nothing twice, (ii) do nothing then 
adding a square, (hi) removing a square then doing nothing, or (iv) removing a square and then 
adding a square. Note that if the length is larger than 0, A 1 = 0. If the vacillating tableau is of 
empty shape, then A 2n_1 = as well. 

Example 1. Abbreviate A = (Ai, A2, . . . ) by A1A2 • • ■ . There are 5 vacillating tableaux of shape 
and length 6. They are 

A A 1 A 2 A 3 A 4 A 5 A 6 

1 

1 1 U 
1 
1110 

Example 2. An example of a vacillating tableau of shape 11 and length 10 is given by 

0,0,1,1,1,1,2,2,21,11,11. 

Theorem 5. (i) Let g\(n) be the number of vacillating tableaux of shape A h k and length 2n. 
By a standard Young tableau (SYT) of shape A, we mean an array T of shape A whose entries are 
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distinct positive integers that increase in every row and column. The content of T is the set of 
positive integers that appear in it. (We don't require that content(A) = [k], where A h k.) We then 
have 

g x (n) =B{n,k)f x , 

where f x is the number of SYT's of shape A and content [k], and B(n, k) is the number of partitions 
of [n] with k blocks distinguished. 

(ii) The exponential generating function of B(n, k) is given by 

£ B(n, k)- = -{e x - If exp(e* - 1). (5) 

n>0 n ' 

To prove Theorem |S1 we construct a bijection between the set V^ n of vacillating tableaux of 
shape A and length 2n, and pairs (P, T), where P is a partition of [n], and T is an SYT of shape A 
such that content(T) C max(P). In the next section we apply this bijection to vacillating tableaux 
of empty shape, and related it to the enumeration of crossing and nesting numbers of a partition. 
In the following we shall assume familiarity with the RSK algorithm, and use row-insertion P < — k 
as the basic operation of the RSK algorithm. For the notation, as well as some basic properties 
of the RSK algorithm, see e.g. |251 Chapter 7]. In general we shall apply the RSK algorithm to a 
sequence w of distinct integers, denoted by w (A(w), B(w)), where A(w) is the (row)-insertion 
tableau and B(w) the recording tableau. The shape of the SYT's A(w) and B(w) is also called the 
shape of the sequence w. 

The Bijection ifi from Vacillating Tableaux to Pairs (P,T). 
Given a vacillating tableau V = (0 = A , A , . . . , A 2n = A), we will recursively define a sequence 
(Pq,Tq), (Pi,Ti),. . . , (P2n,T2 n ) where Pj is a set of ordered pairs of integers in [n], and Tj is an 
SYT of shape A*. Let Po be the empty set, and let To be the empty SYT (on the empty alphabet). 

1. If A* = A 1 " 1 , then (P,T 4 ) = (P^T^). 

2. If A* D A 1-1 , then % = 2k for some integer k £ [n]. In this case let Pj = Pj-i and Tj is obtained 
from Tj-i by adding the entry k in the square A* \ A 1-1 . 

3. If A* C A 2-1 , then i = 2k — 1 for some integer k S [n]. In this case let Tj be the unique SYT 
(on a suitable alphabet) of shape A* such that Tj_i is obtained from Tj by row-inserting some 
number j. Note that j must be less than k. Let Pj be obtained from Pj-i by adding the 
ordered pair (j, k) . 

It is clear from the above construction that (i) Po C Pi C • • • C P 2n , (ii) for each integer i, it 
appears at most once as the first component of an ordered pair in P2.n1 and appears at most once 
as the second component of an ordered pair in P^n- Let ip(V) = (P, T2 n ), where P is the partition 
on [n] whose standard representation is Pm- 
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Note that if an integer i appears in T2„, then Pm can not contain any ordered pair (i,j) with 
i < j. It follows that i is the maximal element in the block containing it. Hence the content of Tm 
is a subset of max(P). 

Example 3. As an example of the map ip, let the vacillating tableau be 

0,0,1,1,2,2,2,2,21,21,211,21,21,11,21. 
Then the pairs (Pj,Tj) (where Bi is the pair added to P%—\ to obtain Pi) are given by 



i 


0123456789 


10 


11 


12 


13 


14 


Ti 


1 1 12 12 12 12 12 12 


12 


14 


14 


1 


17 




4 4 


4 


5 


5 


5 


5 






5 
















(2,6) 




(4,7) 





Hence 

T = I 7 , P = 1-26-3-47-5. 

5 

The map ip is bijective since the above construction can be reversed. Given a pair (P, T), where 
P is a partition of [n] , and T is an SYT whose content consists of maximal elements of some blocks 
of P, let E(P) be the standard representation of P, and T2 n = T. We work our way backwards 
from T2 n , reconstructing the preceding tableaux and hence the sequence of shapes. If we have the 
SYT for some k < n, we can get the tableaux T2fc-i) P2&-2 by the following rules. 

1. ?2fc_i = T2k if the integer k does not appear in T2k- Otherwise T2k-i is obtained from T2k by 
deleting the square containing k. 

2. T2k-2 = ?2fe-i if E(P) does not have an edge of the form (i, k). Otherwise there is a unique 
i < k such that (i, k) G E(P). In that case let T2k-2 be obtained from T2k-i by row-inserting 
i, or equivalently, T 2fc _ 2 = (T 2k -i < — i). 

Proof of Theorem |SJ Part (i) follows from the bijection ip, where a block of P is distinguished 
if its maximal element belongs to content (T). For part (ii), simply note that to get a structure 
counted by B(n,k), we can partition [n] into two subsets, S and T, and then partition S into 
k blocks and put a mark on each block, and partition T arbitrarily. The generating function of 
B(n,k) then follows from the well-known generating functions for S(n,k), the Stirling number of 
the second kind, and for the Bell number B(n), 

n>k n>0 



7 



Remark. (1). Restricting to vacillating tableaux of empty shape, the map V provides a 
bijection between the set Vg n of vacillating tableaux of empty shape and length In and the set of 
partitions of [n]. In particular, g$(n), the cardinality of Vg n , is equal to the nth Bell number B{n). 

(2). Note that there is a symmetry between the four types of movements in the definition of 
vacillating tableaux. Thus any walk from to in m + n steps can be viewed as a walk from to 
some shape A in n steps, then followed by the reverse of a walk from to A in m steps. It follows 
that 



For the case m = n = k, the identity © is proved by Halverson and Lowandowski [TS|, who gave 
a bijective proof using similar procedures as those in ip. 

(3). The partition algebra ty n is a certain semisimple algebra, say over C, whose dimension is 
the Bell number B(n) (the number of partitions of [n]). (The algebra *p n depends on a parameter x 
which is irrelevant here.) See |151 116j for a survey of this topic. Vacillating tableaux are related to 
irreducible representations of ty n in the same way that SYT of content [n] are related to irreducible 
representations of the symmetric group S n . In particular, the irreducible representations I\ of *p n 
are indexed by partitions A for which there exists a vacillating tableau of shape A and length 2n, and 
dim/ n is the number of such vacillating tableaux. This result is equivalent to |151 Thm. 2.24(b)], 
but that paper does not explicitly define the notion of vacillating tableau. Combinatorial identities 
arising from partition algebra and its subalgebras are discussed in ^H] , where the authors used the 
notion of vacillating tableau after the distribution of a preliminary version of this paper. 

3 Crossings and Nestings of Partitions 

In this section we restrict the map ip to vacillating tableaux of empty shape, for which ip provides 
a bijection between the set of vacillating tableaux of empty shape and length 2n and the set of 
partitions of [n]. To make the bijection clear, we restate the inverse map from the set of partitions 
to vacillating tableaux. 

The Map <ft from Partitions to Vacillating Tableaux. Given a partition P G II n with the 
standard representation, we construct the sequence of SYT's, hence the vacillating tableau (j)(P) 
as follows: Start from the empty SYT by letting Tin = ; read the number j € [n] one by one from 
n to 1, and define Tij-i, T2j-2 for each j. There are four cases. 

1. If j is the righthand endpoint of an arc but not a lefthand endpoint, first do nothing, then 
insert i (by the RSK algorithm) into the tableau. 

2. If j is the lefthand endpoint of an arc (j, k), but not a righthand endpoint, first remove j, then 
do nothing. 

3. If j is an isolated point, do nothing twice. 




(6) 



A 
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4. If j is the righthand endpoint of an arc and the lefthand endpoint of another arc (j,k), 

then delete j first, and then insert i. 

The vacillating tableau 4>{P) is the sequences of shapes of the above SYT's. 
Example 4. Let P be the partition 1457-26-3 of [7]. 




1 2 3 4 5 6 7 



Figure 1: The standard representation of the partition 1457-26-3. 

Starting from on the right, go from 7 to 1, the seven steps are (1) do nothing, then insert 5, 
(2) do nothing, then insert 2, (3) delete 5 and insert 4, (4) delete 4 and insert 1, (5) do nothing 
twice, (6) remove 2 then do nothing, (7) remove 1 then do nothing. Hence the corresponding SYT's, 
constructed from right to left, are 

00111112 24 225500 
2 2 2 5 

The vacillating tableau is 

0,0,1,1,11,11,11,1,2,1,11,1,1,0,0. 
The relation between cr(P),ne(P) and the vacillating tableau is given in the next theorem. 

Theorem 6. Let P £ U n and <p(P) = (0 = A , A 1 , . . . , A 2n = 0). Then cr(P) is the most number 
of rows in any A\ and ne(P) is the most number of columns in any A*. 

Proof. We prove Theorem|f)]in four steps. First, we interpret a fc-crossing//c-nesting of P in terms 
of entries of SYT's in <ft(P). Then, we associate to each SYT Tj a sequence cr, whose terms are 
entries of Tj. We prove that Tj is the insertion tableau of Ui under the RSK algorithm, and apply 
Schensted's theorem to conclude the proof. 

Step 1. Let T(P) = (Tq,T\, . . . ,T2n) be the sequence of SYT's associated to the vacillating 
tableau (ft(P). By the construction of tp and 0, a pair is an arc in the standard representation 
of P if and only if i is an entry in the SYT's T21, I^i+ij • • • , Pij-2- We say that the the integer % is 
added to T(P) at step i and leaves at step j. 

First we prove that the arcs (ii, Ji), ■ ■ ■ , (iki Jk) form a ^-crossing of P if and only if there exists 
a tableau Tj in T(P) such that the integers i\, 12, ■ ■ ■ , ik G content (Tj), and ii, «2, • • • > ifc leave T(P) 
in increasing order according to their numerical values. Given a /c-crossing ((ii, ji), . . . , (ik,jk)) of 
P, where i r < j r for 1 < r < k and i± < 12 < ■ ■ ■ < ik < ji < 32 < ' ' ' < 3k, the integer i r is 
added to T(P) at step i r and leaves at step j r . Hence all i r are in T2 jl _2, and they leave T(P) in 
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increasing order. The converse is also true: if there are k integers i\ < 12 < ■ ■ ■ < ik ah appearing in 
the same tableau at some steps, and then leave in increasing order, say at steps j\ < j% < ■ ■ ■ < jk, 
then ifo < j\ and the pairs ((ii, ji ),■■■, (ikiJk)) £ P form a /c-crossing. By a similar argument arcs 
■ ■ ■ , (ik,jk) form a fe-nesting of P if and only if there exists a tableaux Tj in T(P) such that 
the integers h,i2, ■ ■ ■ ,ik £ content (1$), and ii, . . . , ik leave T{P) in decreasing order. 

Step 2. For each Tj E T(P), we define a permutation <7j of content (T) (backward) recursively 
as follows. Let 02n be the empty sequence. (1) If Tj = Tj_i, then Oi~\ = o^. (2) If T_i is obtained 
from Ti by row-inserting some number j, then <7j_i = the juxtaposition of <7j and j. (3) If T, 
is obtained from T_i by adding the entry i/2, (where i must be even), then o"j_i is obtained from 
Oi by deleting the number i/2. Note that in the last case, i/2 must be the largest entry in Uj. 

Clearly Uj is a permutation of the entries in content (Tj). If cxj = W1W2 ■ ■ ■ w r , then the entries 
of content (Tj) leave T(P) in the order w r , ■ ■ ■ , W2, w\. 

Step 3. Claim: If a { ^ (A h B t ), then A { = Ti. 

We prove the claim by backward induction. The case i = 2n is trivial as both Am and T<m are 
the empty SYT. Assume the claim is true for some i, 1 < i < 2n. We prove that the claim holds 
for i — 1. 

If Tj_i = Tj, the claim holds by the inductive hypothesis. If Tj_i is obtained from Tj by inserting 
the number j, then the claim holds by the definition of the RSK algorithm. It is only left to consider 
the case that T_i is obtained from Tj by removing the entry j = i/2. 

Let us write <7j as u\U2 ■ ■ ■ u s jv\ ■ • • vt, and <7j_i as U1U2 • • • u s v\ ■ ■ ■ vt, where j > u\, ■ ■ ■ , u s ,v\, . . . ,vt- 
We need to show that the insertion tableau of <Tj_i is the same as the insertion tableau of <7j delet- 
ing the entry j, i.e., Aj_i = Ai\{j}. Proof by induction on t. If t = then it is true by 
the RSK algorithm that A4 is obtained from Aj_i by adding j at the end of the first row. As- 
sume it is true for t — 1, i.e., A{u\ ■ ■ ■ u s v\ ■ ■ ■ vt-\) = A{u\ ■ ■ ■ u s jv\ ■ ■ ■ vt-i) \ {j}. Note that in 
A(u\ ■ ■ ■ u s jvi ■ ■ ■ vt-i), if j is in position (x, y), then there is no element in positions (x, y + 1) 
or {x + 1,2/). Now we insert the entry vt by the RSK algorithm. Consider the insertion path 
I = I(A(u\ • ■ ■ u s jvi • ■ ■ v t -i) < — vt). If j does not appear on this path, then we would have the 
exact same insertion path when inserting vt into A(u\ ■ ■ ■ u s vi ■ ■ ■ vt-i). This insertion path results 
in the same change to A{u\ ■ ■ ■ u s jv\ ■ ■ ■ vt-i) and A(u\ ■ ■ ■ u s v\ ■ ■ ■ vt-i), which does not touch the 
position (x, y) of j. So A(u\ ■ ■ ■ u s v\ ■ ■ ■ vt-ivt) = A(u\ ■ ■ ■ u s jv\ ■ ■ ■ vt-\Vt)\{j} ■ On the other hand, 
if j appears in the insertion path /, i.e., (x,y) G /, then since j is the largest element, it must be 
bumped into the (x + l)-th row, and become the last entry in the (x + l)-th row without bumping 
any number further. Then the insertion path of vt into A(u\ ■ ■ ■ u s vi ■ ■ ■ Vt-i) is I minus the last 
position {(x + 1, *)}, and again we have A(u\ ■ ■ ■ u s v\ ■ ■ ■ vt-±vt) = A(u± ■ ■ ■ u s jv\ ■ ■ ■ v t -iv t ) \ {j}. 
This finishes the proof of the claim. 

Step 4. We shall need the following theorem of Schensted [H][2I3 Thms. 7.23.13, 7.23.17], 
which gives the basic connection between the RSK algorithm and the increasing and decreasing 
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subsequences. 

Schensted's Theorem Let a be a sequence of integers whose terms are distinct. As- 
sume a 5" (A, B), where A and B are SYT's of the shape A. Then the length of the 
longest increasing subsequence of a is Ai (the number of columns of A), and the length 
of the longest decreasing subsequence is \[ (the number of rows of A) . 

Now we are ready to prove Theorem By Steps 1 and 2, a partition P has a /c-crossing if 
and only if there exists i such that <7j has a decreasing subsequence of length k. The claim in Step 
3 implies that the shape of the sequence cr, is exactly the diagram of the i-th partition X 1 in the 
vacillating tableau 4>(P). By Schensted's Theorem, Uj has a decreasing subsequence of length k if 
and only if the partition A* in <j){P) has at least k rows. This proves the statement for cr(P) in 
Theorem El The statement for ne(P) is proved similarly. □ 

The symmetric joint distribution of statistics cr(P) and ne(P) over P n (S, P) follows immediately 
from Theorem El 
Proof of Theorem 1. 

From Theorem |H1 a partition P 6 IT n has cr(P) = k and ne(P) = j if and only if for the 
partitions {A l } 2 ™ of the vacillating tableau <fi(P), the maximal number of rows of the diagram of 
any A* is k, and the maximal number of columns of the diagram of any \ l is j. Let r be the involution 
defined on the set Vqj n by taking the conjugate to each partition A 1 . For i 6 [n], i € min(P) (resp. 
max(P)) if and only if A 2 *" 1 = A 2i ~ 2 and A 2i \A 2 ^ x = □, (reps. A 2i - 2 \A 2i ~ x = □ and A 2i = A 2 *" 1 ). 
Since r preserves min(P) and max(P), it induces an involution on P n (S,T) which exchanges the 
statistics cr(P) and ne(P). This proves Theorem ^ □ 

Let A = (Ai, A2, . . . ) be the shape of a sequence w of distinct integers. Schensted's Theorem 
provides a combinatorial interpretation of the terms Ai and A^: they are the length of the longest 
increasing and decreasing subsequences of w. In 14 C. Greene extended Schensted's Theorem by 
giving an interpretation of the rest of the diagram of A = (Ai, A2, . . . ). 

Assume w is a sequence of length n. For each k < n, let dk(w) denote the length of the longest 
subsequence of w which has no increasing subsequences of length k + 1. It can be shown easily that 
any such sequence is obtained by taking the union of k decreasing subsequences. Similarly, define 
cik{w) to be the length of the longest subsequence consisting of k ascending subsequences. 

Theorem 7 (Greene). For each k < n, 

a k (w) = Ai + A 2 H hA fe , 

d k {w) = X[ + X' 2 + --- + \' k , 

where A' = (A' x , A' 2 , . . . ) is the conjugate of A. □ 
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We may consider the analogue of Greene's Theorem for set partitions. Let P S Tl n with the 
standard representation {(ii, ji), (12, 32), ■ ■ • , (it, jt)}, where i r < j r for 1 < r < t. Let e r = (i r ,j r )- 
We define the crossing graph Cr(P) of P as follows. The vertex set of Cr(P) is {ei, . . . , et}- Two 
arcs e r and e s are adjacent if and only if the edges e r and e s are crossing, that is, i r < i s < j r < j s . 
Clearly a /c-crossing of P corresponds to a fc-clique of Cr(P). Let cr r (P) be the maximal number of 
vertices in a union of r cliques of Cr(P). In other words, cr r (P) is the maximal number of arcs in 
a union of r crossings of P. Similarly, let Ne(P) be the graph defined on the vertex set {ei, . . . , e{\ 
where two arcs e r and e s are adjacent if and only if i r < i s < j s < j r . Let ne r (P) be the maximal 
number of vertices in a union of r cliques of Ne(P). In other words, ne r (P) is the maximal number 
of arcs in a union of r nestings of P. 

Proposition 8. Let P = («2> 32), ■ ■ ■ j (it,jt)) be the standard representation of a partition 

of [n], where i r < j r for all 1 < r < t and j\ < jz < ' • ■ < jt- Let a(P) be the sequence i\%2 ■ ■ ■ it- 
Then there is a one-to-one correspondence between the set of nestings of P and the set of decreasing 
subsequences of a(P). 

Proof. Let <p(P) be the vacillating tableau corresponding to P, and T(P) the sequence of SYT's 
constructed in the bijection. Then a(P) records the order in which the entries of Tj's leave T(P). 
Let a = if ■ - izH be the reverse of a(P), and {cij : 1 < i < 2n} the permutation of content(Tj) 
defined in Step 2 of the proof of Theorem El Then the oVs are subsequences of a. 

From Steps 1 and 2 of the proof of Theorem |SJ nestings of P are represented by the increasing 
subsequences of crj, 1 < i < 2n, and hence by the increasing subsequences of a. Conversely, let 
i ri < i r% < ■ ■ ■ < i n be an increasing subsequence of a. Being a subsequence of a means that its 
terms leave T(P) in reverse order, so i rt leaves first in step j rt . Thus all the entries i ri , . . . , i n appear 
in the SYT's Tj with 2i rt < i < 2j rt — 2. Therefore i ri i r2 " ■ ■ in is a l so an increasing subsequence of 
aj, for 2i n < i < 2j rt —2. □ 

Combining Proposition |H] and Greene's Theorem, we have the following corollary describing 
ne t (P). 

Corollary 9. Let P and a(P) be as in Proposition |HJ Then 

ne r (P) = Ai + A^ + .-. + A^, 

where A is the shape of a(P), and A' is the conjugate of A. □ 

The situation for cr r (P) is more complicated. We don't have a result similar to Proposition |HJ 
Any crossing of P uniquely corresponds to an increasing subsequence of a(P). But the converse is 
not true. An increasing subsequence i ri i r2 ■ ■ ■ i rt corresponds to a t-crossing of P only if we have 
the additional condition i n < j ri . It would be interesting to get a result for cr r (P) analogous to 
Corollary |5J 

To conclude this section we discuss the enumeration of noncrossing partitions. The following 
theorem is a direct corollary of the bijection between vacillating tableaux and partitions. 
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Theorem 10. Let denote the ith unit coordinate vector in R fc 1 . The number of fc-noncrossing 
partitions of [n] equals the number of closed lattice walks in the region 

Vk = {(ai,a 2 , • • • , dfc-i) ■■ ai > a 2 > ■ ■ ■ > a/c_i > 0, a» G Z} 

from the origin to itself of length 2n with steps ±ej or (0, 0, . . . , 0), with the property that the walk 
goes backwards (i.e., with step — e«) or stands still (i.e., with step (0, 0, ... , 0)) after an even number 
of steps, and goes forwards (i.e., with step +£») or stands still after an odd number of steps. □ 

Recall that a partition P G Tl n is k-noncrossing if cr(i-*) < k, and is k-nonnesting if ne(-P) < k. 
A partition P has no ^-crossings and no j-nestings if and only if for all the partitions X 1 of 4>(P), 
the diagram fits into a (k — 1) X (j — 1) rectangle. Taking the conjugate of each partition, we get 
bijective proofs of Corollaries |2] and 01 

Theoremnasserts the symmetric distribution of cr(P) and ne(-P) over P n (S, T), for all S,TC [n] 
with IS"! = \T\. Not every P n (S,T) is nonempty. A set P n (S,T) is nonempty if and only if for all 
i £ [n], \Sn[i]\ > |TPl Another way to describe the nonempty P n (S,T) is to use lattice paths. 
Associate to each pair (S,T) a lattice path L(S,T) with steps (1, 1), (1, —1) and (1,0): start from 
(0,0), read the integers i from 1 to n one by one, and move two steps for each i. 

1. If i G S n T, move (1, 0) twice. 

2. If i G S \ T, move (1, 0) then (1, 1). 

3. If i GT\ S, move (1,-1) then (1,0). 

4. If i <£ S U T, move (1, -1) then (1, 1). 

This defines a lattice path L(S,T) from (0,0) to (2n,0), Conversely, the path uniquely determines 
(S,T). Then P n (S,T) is nonempty if and only if the lattice path L(S,T) is a Motzkin path, i.e., 
never goes below the x-axis. 

There are existing notions of noncrossing partitions and nonnesting partitions, e.g., |251 Ex.6. 19]. 
A noncrossing partition of [n] is a partition of [n] in which no two blocks "cross" each other, i.e., 
if a < b < c < d and a,c belong to a block B and 6, d to another block B' , then B = B'. A 
nonnesting partition of [n] is a partition of [n] such that if a, e appear in a block B and b, d appear 
in a different block B' where a < b < d < e, then there is a c G B satisfying b < c < d. 

It is easy to see that P is a noncrossing partition if and only if the standard representation 
of P has no 2-crossing, and P is a nonnesting partition if and only if the standard representation 
of P has no 2-nesting. Hence the vacillating tableau correspondence, in the case of 1-row/column 
tableaux, gives bijections between noncrossing partitions of [n], nonnesting partitions of [n], (both 
are counted by Catalan numbers) and sequences = ao,a%,..., a2 n = of nonnegative integers such 
that a2i+i = a,2i or a 2 i — 1, and a 2 % = «2i-i or ti2«-i + 1- These sequences ao, ■■■,a 2n give a new 
combinatorial interpretation of Catalan numbers. 

Replacing a term Oj+i = + 1 with a step (1, 1), a term ai + \ = — 1 with a step (1,-1), and 
a term a^+i = with a step (1,0), we get a Motzkin path, so we also have a bijection between 
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noncrossing/nonnesting partitions and certain Motzkin paths. The Motzkin paths are exactly the 
ones defined as L(S,T), where S = min(P) and T = max(P). Conversely, given a Motzkin path 
of the form L(S,T), we can recover uniquely a noncrossing partition and a nonnesting partition. 
Write the path as {(i,Oi) ■ < i < 2n}. Let A = [n]\T and B = [n] \ S. Clearly |A| = \B\. 
Assume A = {ii, . . . , it}<, and B = {ji, j2, ■ ■ ■ , jt}< where elements are listed in increasing 
order. Then to get the standard representation of the noncrossing partition, pair each j r with 
max{i s £ A : i s < j r , «2i s = «2>-2}- To get the standard representation of the nonnesting 
partition, pair each j r with i r , for 1 < r < t. 

Remark. In our definition, a /c-crossing is defined as a set of k mutually crossing arcs in the 
standard representation of the partition. There exist some other definitions. For example, in 
M. Klazar defined 3-noncrossing partition as a partition P which does not have 3 mutually crossing 
blocks. It can be seen that P is 3-noncrossing in Klazar's sense if and only if there do not exist 6 
elements a\ < b\ < oy < 02 < &2 < C2 in [n] such that a%,a2 € A, bi, 62 G B, c\,C2 £ C, and A, B, C 
are three distinct blocks of P. 

Klazar's definition of 3-noncrossing partitions is different from ours. For example, let P be the 
partition 15-246-37 of [7], with standard representation as follows: 



According to Klazar's definition, P has a 3-crossing, since we have 1<2<3<5<6<7 and 
{1, 5}, {2, 6} and {3, 7} belong to three different blocks, respectively. On the other hand, P has no 
3-crossing on our sense. 

For general k, these three notions of /c-noncrossing partitions, i.e., (1) no /c-crossing in the 
standard representation of P, (2) no k mutually crossing arcs in distinct blocks of P, and (3) no 
k mutually crossing blocks, are all different, with the first being the weakest, and the third the 
strongest. 

4 A Variant: Partitions and Hesitating Tableaux 

We may also consider the enhanced crossing/nesting of a partition, by taking isolated points into 
consideration. For a partition P of [n], let the enhanced representation of P be the union of the 
standard representation of P and the loops {(i, i) : i is an isolated point of P}. An enhanced k- 
crossing of P is a set of k edges {h,ji), (^2^2)) • • • , (ik,jk) of the enhanced representation of P such 
that i% < 12 < • • • < ik < ji < J2 < • • • < jk- I n particular, two arcs of the form (i,j) and (j, I) 
with i < j < I are viewed as crossing. Similarly, an enhanced k-nesting of P is a set of k edges 
(h, ji), i}2i 32)1 ■ ■ ■ , (ik,jk) of the enhanced representation of P such that i\ < 12 < • • • < ik < jk < 
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■ • • < j2 < j\- In particular, an edge (i, k) and an isolated point j with i < j < k form an enhanced 
2-nesting. 

Let cr(P) be the size of the largest enhanced crossing, and ne(P) the size of the largest enhanced 
nesting. Using a variant form of vacillating tableau, we obtain again a symmetric joint distribution 
of the statistics cr(P) and ne(P). 

The variant tableau is a hesitating tableau of shape and length 2n, which is a path on the 
Hasse diagram of Young's lattice from to where each step consists of a pair of moves, where the 
pair is either (i) doing nothing then adding a square, (ii) removing a square then doing nothing, or 
(hi) adding a square and then removing a square. 

Example 5. There are 5 hesitating tableaux of shape and length 6. They are 

10 1 10 
10 10 

1 11 1 (7) 
1 1 
1 2 10 

To see the equivalence with vacillating tableaux, let U be the operator that takes a shape to 
the sum of all shapes that cover it in Young's lattice (i.e., by adding a square), and similarly D 
takes a shape to the sum of all shapes that it covers in Young's lattice (i.e., by deleting a square). 
Then, as is well-known, DU — UD = I (the identity operator). See, e.g. |23| |251 Exer. 7.24]. It 
follows that 

(U + I)(D + I) = DU + ID + UI. (8) 

Iterating the left-hand side generates vacillating tableaux, and iterating the right-hand side gives 
the hesitating tableaux defined above. 

A bijective map between partitions of [n] and hesitating tableaux of empty shape has been 
given by Korn ^H], based on growth diagrams. Here by modifying the map (j) defined in Section |3] 
we get a more direct bijection between partitions and hesitating tableaux of empty shape, which 
leads to the symmetric joint distribution of cr(P) and ne(P). The construction and proofs are very 
similar to the ones given in Sections [2 and |21 and hence are omitted here. We will only state the 
definition of the map <p from partitions to hesitating tableaux, to be compared with the map eft in 
Section |3J 

The Bijection cf> from Partitions to Hesitating Tableaux. 

Given a partition P 6 II n with the enhanced representation, we construct the sequence of SYT's, 
and hence the hesitating tableau 4>(P), as follows: Start from the empty SYT by letting T2 n = 0, 
read the numbers j E [n] one by one from n to 1, and define two SYT's T^j— 1> ^2j-2 for each j. 
When j is a lefthand endpoint only, or a righthand endpoint only, the construction is identical to 
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that of the map <j). Otherwise, 

1. If j is an isolated point, first insert j, then delete j. 

2. If j is the righthand endpoint of an arc and the lefthand endpoint of another arc (j,k), 
then insert i first, and then delete j. 

Example 6. For the partition 1457-26-3 of [7] in Figure EJ the corresponding SYT's are 

1 1 1 13 1 14 24 24 2 5 5 
2 2 2 2 5 5 

The hesitating tableau </>(P) is 

0,0,1,1,11,21,11,21,2,21,11,1,1,0,0. 




1 2 3 4 5 6 7 



Figure 2: The enhanced representation of the partition 1457-26-3. 

The conjugation of shapes does not preserve min(P) or max(P). Instead, it preserves min(P)\ 
max(P), and max(P) \ min(P). Let S,T be disjoint subsets of [n] with the same cardinality, 
P n (S,T) = {P G II n : min(P)\max(P) = S, max(P) \min(P) = T}, and f n ,S,T(hj) = #{P G 
P n (S,T):W(P)=i,ne(P)=j}. 

Theorem 11. We have 

fn,S,T(i,j) = fn,S,T{j,i)- □ 

As a consequence, Corollaries |^1 and |21 remain valid if we define /c-noncrossing (or fe-nonnesting) 
by cr(P) < k (or rie(P) < k). 

Remark. As done for vacillating tableaux, one can extend the definition of hesitating tableaux 
by considering moves from to A, and denote by f\{n) the number of such hesitating tableaux of 
length 2n. Identity (JSJ implies that f\(n) = g\(n), the number of vacillating tableaux from to A. 
It follows that f$(n) = B(n), and 

^2 /aW/xH = B(m + n), 
A 

where B(n) is the nth Bell number. For further discussion of the number f\(n), see |26( Problem 
33] (version of 17 August 2004). 
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5 Enumeration of /c-Noncrossing Matchings 



Restricting Theorem ^ to disjoint subsets (S,T) of [n], where n = 2m and | *S' | = \T\ = m, we 
get the symmetric joint distribution of the crossing number and nesting number for matchings, as 
stated in Corollary |I] in Section 1. 

In a complete matching, an integer is either a left endpoint or a right endpoint in the standard 
representation. In applying the map <f> to complete matchings on [2m], if we remove all steps which 
do nothing, we obtain a sequence = A , A 1 , . . . , A 2m = of partitions such that for all 1 < i < 2m, 
the diagram of A* is obtained from that of A J_1 by either adding one square or removing one square. 
Such a sequence is called an oscillating tableau (or up-down tableau) of empty shape and length 
2m. Thus we get a bijection between complete matchings on [2m] and oscillating tableaux of empty 
shape and length 2m. This bijection was originally constructed by the fourth author, and then 
extended by Sundaram [27j to arbitrary shapes to give a combinatorial proof of the Cauchy identity 
for the symplectic group Sp(2m). The explicit description of the bijection has appeared in [57j and 
was included in 25, Exercise 7.24]. Oscillating tableaux first appeared (though not with that name) 
in 0. 

Recall that the ordinary RSK algorithm gives a bijection between the symmetric group & m and 
pairs (P, Q) of SYTs of the same shape A h m. This result and the Schensted's theorem can be 
viewed as a special case of what we do. Explicitly, identify an SYT T of shape A and content [m] 
with a sequence = A , A , ... , X m = A of integer partitions where A* is the shape of the SYT T l 
obtained from T by deleting all entries {j : j > i}. Let wbea permutation of [m], and form the 
matching M w on [2m] with arcs between w(i) and 2m — i + 1. We get an oscillating tableau O w that 

R.SK 

increases to the shape A h m and then decreases to the empty shape. Assume w i — > (A(w),B(w)), 
where A(w) is the (row)-insertion tableau and B(w) the recording tableau. Then A(w) is given by 
the first m steps of O w , and B(w) the reverse of the last m steps. The size of the largest crossing 
(resp. nesting) of M w is exactly the length of the longest decreasing (resp. increasing) subsequence 
of w. 

Example 7. Let w = 231. Then 

s 13 , . 12 

A{w)= 2 , B(w)= s . 

The matching M w and the corresponding oscillating tableau are given below. 




Remark. The Brauer algebra 25 m is a certain semisimple algebra, say over C, whose dimension 
is the number 1 • 3 • • • • (2m — 1) of matchings on [2m]. (The algebra 25 m depends on a parameter x 
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which is irrelevant here.) Oscillating tableaux of length 2m are related to irreducible representations 
of QS TO in the same way that SYT of content [m] are related to irreducible representations of 
the symmetric group & m and that vacillating tableaux of length 2m are related to irreducible 
representations of the partition algebra *p m . In particular, the irreducible representations J\ of 
<B m are indexed by partitions A for which there exists an oscillating tableau of shape A and length 
2m, and dim J\ is the number of such oscillating tableaux. See e.g. jU Appendix B6] for further 
information. 

Next we use the bijection between complete matchings and oscillating tableaux to study the 
enumeration of /c-noncrossing matchings. All the results in the following hold for /c-nonnesting 
matchings as well. 

For complete matchings, Theorem I1UI becomes the following. 

Corollary 12. The number of /c-noncrossing matchings of [2m] is equal to the number of closed 
lattice walks of length 2m in the set 

Vfc = {(ai,a 2 , ■ ■ ■ ,a fc _i) : ai > a 2 > ••• > a fc _i > 0,aj G 1} 

from the origin to itself with unit steps in any coordinate direction or its negative. □ 

Restricted to the cases k = 2, 3, Corollary II 21 leads to some nice combinatorial correspondences. 
Recall that a Dyck path of length 2m is a lattice path in the plane from the origin (0, 0) to (2m, 0) 
with steps (1,1) and (1,-1), that never passes below the x-axis. A pair (P,Q) of Dyck paths is 
noncrossing if they have the same origin and the same destination, and P never goes below Q. 

Corollary 13. 1. The set of 2-noncrossing matchings is in one-to-one correspondence with the 
set of Dyck paths. 

2. The set of 3-noncrossing matchings is in one-to-one correspondence with the set of pairs of 
noncrossing Dyck paths. 

Proof. By Corollary 1121 2-noncrossing matchings are in one-to-one correspondence with closed 
lattice paths {vi = (xi)}f™ with xq = X2 m = 0, X{ > and Xi+i — xi = ±1. Given such a 1- 
dimensional lattice path, define a lattice path in the plane by letting P = {(i, Xi) \ i = 0, 1, . . . , 2m}. 
Then P is a Dyck path, and this gives the desired correspondence. 

For k = 3, 3-noncrossing matchings are in one-to-one correspondence with 2-dimensional lattice 
paths = (xi,yi)}?™ with (x ,yo) = {x 2m ,y2m) = (0,0), xi > yt > and (x i+1 ,y i+1 ) - {x i} yi) = 
(±1,0) or (0, ±1). Given such a lattice path, define two lattice paths in the plane by setting 
P = {(i, Xi + yi) | i = 0, 1, . . . , 2m} and Q = {(i, Xj — yi) \ i = 0, 1, . . . , 2m}. Then (P, Q) is a pair of 
noncrossing Dyck paths. It is easy to see that this is a bijection. □ 

Example 8. We illustrate the bijections between 3-noncrossing matchings, oscillating tableaux, 
and pairs of noncrossing Dyck paths. The oscillating tableau is 

0,1,2,21,31,21,11,21,2,1,0. 
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The sequence of SYT's as denned in the bijection is 



12 12 4 12 1 17 „_ o 

' ' 3 '3 '3 ' 3 ' 3 



The corresponding matching and the pair of noncrossing Dyck paths are given in Figure 01 



123456789 10 




Figure 3: The matching and the pair of noncrossing Dyck paths. 



,2m 



Let fk(m) be the number of k- noncrossing matchings of [2m]. By Corollary 1121 it is also the 
number of lattice paths of length 2m in the region from the origin to itself with step set 
{±ei,±e 2 , • • • ,±e fe _i}. Set 

m v ' 

It turns out that a determinantal expression for Ff.(x) has been given by Grabiner and Magyar 
[T2*] . It is simply the case A = ry = (m, m — 1, 1) of equation (38) in J2]> giving 



F k (x) = det [J i _ j (2x) - 7 i+i (2x)]fTi 1 , 



0) 



where 



I m (2x) = 



r m+2j 



j>0 



j\(m + j)V 



the hyperbolic Bessel function of the first kind of order m [SO]. One can easily check that when 
k = 2, the generating function of 2-noncrossing matchings equals 

,2? 



F 2 (x) = I (2x) - I 2 (2x) =J2 C : 



x 



j>0 

where Cj is the j-th Catalan number. When k = 3, we have 



J (2j)! 



h{m) 



3!(2m + 2)! 



m!(m + l)!(m + 2)\(m + 3)! 



This result agrees with the formula on the number of pairs of noncrossing Dyck paths due to 
Gouyou-Beauchamps in [TT] , 



19 



Remark. The determinant formula © has been studied by Baik and Rains in 2, Eqs. (2.25)]. 
One simply puts i — 1 for j and j — 1 for k in (2.25) of |2j to get our formula. The same formula 
was also obtained by Goulden ^U] as the generating function for fixed point free permutations 
with no decreasing subsequence of length greater than 2k. See Theorem 1.1 and 2.3 of ^U] and 
specialize hi to be x l /i\, so gi becomes the hyperbolic Bessel function. The asymptotic distribution 
of cr(M) follows from another result of Baik and Rains. In Theorem 3.1 of 3: they obtained the 
limit distribution for the length of the longest decreasing subsequence of fixed point free involutions 
w. But representing w as a matching M, the condition that w has no decreasing subsequence of 
length 2k + 1 is equivalent to the condition that M has no k + 1-nesting, and we already know that 
cr(M) and ne(M) have the same distribution. Combining the above results, one has 

/ cr(M) - x\ 

llm Pr fn M/6 - 9 = Fl ( X )' 

m-»oo \ (2m) i /° 2 / 

where 

F 1 (x) = y/F\xjexp Q y u(s)ds 

where .F(x) is the Tracy- Widom distribution and u(aj) the Painleve II function. 

Similarly one can try to enumerate complete matchings of [2m] with no {k + l)-crossing and 
no (j + l)-nesting. By the oscillating tableau bijection this is just the number of walks of length 
2m from to in the Hasse diagram of the poset L(k,j), where denotes the unique bottom 
element (the empty partition) of L(k,j), the lattice of integer partitions whose shape fits in a k x j 
rectangle, ordered by inclusion. Let <?fcj(m) be this number, and Gkj(x) = Em^jt™) 12 ™ be the 
generating function. 

For j = 1, the number gk,i(m) counts lattice paths from (0,0) to (2m, 0) with steps (1,1) or 
(1, —1) that stay between the lines y = and y = k. The evaluation of guxijn) was first considered 
by Takacs in |28| by a probabilistic argument. Explicit formula and generating function for this 
case are well-known. For example, in one obtains the explicit formula by applying the reflection 
principle repeatedly, viz., 

2m \ / 2m 
K m-i(k + 2)J \m + i(k + 2) + k + 1, 

The generating function Gk,i(x) is a special case of the one for the duration of the game in the 
classical ruin problem, that is, restricted random walks with absorbing barriers at and a, and 
initial position z. See, for example, Equation (4.11) of Chapter 14 of Let 



U z (x) = £ 



v r m 



m=0 



where u Z)n is the probability that the process ends with the n-th step at the barrier 0. Then 

w -/«vrw-*rw 



pj \f(x)-\%{x) 
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where 



Ai(x) 



1 + \Jl- 4pqx 2 
2px 



A 2 (x) 



1 — \J\ — Apqx 2 
2px 

k + 2, z = 1, and p 



(10) 



The generating function Gk,i(x) is just U\{2x)/x with a = A; + 2, z = 1, and p = q = 1/2. 
In general, by the transfer matrix method |24| §4.7] 

det(/-^ fcj (0)) 
^ [X) ~ det(I-xA kJ ) 

is a rational function, where A^j is the adjacency matrix of the Hasse diagram of L(k,j), and 
-Afcj(O) is obtained from by deleting the row and the column corresponding to 0. Akj(0) is 
also the adjacency matrix of the Hasse diagram of L(k,j) with its bottom element (the empty 
partition) removed. Note that det(/ — xA^j) is a polynomial in x 2 since L(k,j) is bipartite 
Thm. 3.11]. Let det(/ — xA^j) = Pk,j{x 2 )- The following is a table of Pk,j{x) for the values of 
1 < k < j < 4. (We only need to list those with k < j since Pk,j(x) = Pj ki x )-) 





Pk, 3 


(x) = det(J - y/xA k j) 




(1,1) 


1 - 


X 




(1,2) 


1 - 


2x 




(1,3) 


1 - 


3x + x 2 




(1,4) 


(1- 


- x)(l — 3x) 




(2,2) 


(1- 


- x)(l — 5x) 




(2,3) 


(1- 


- x)(l - 3x)(l - 8x + 4x 2 )) 




(2,4) 


(1- 


- Ux + 49x 2 - 49x 3 )(l - 6x + 5x 2 - x 3 ) 




(3,3) 


(1- 


- a?)(l - 19x + 83x 2 - x 3 )(l - 5x + 6x 2 - 


-x 3 ) 2 


(3,4) 


(1- 


- 2x) 2 (l - 8x + 8x 2 )(l - 4x + 2x 2 ) 2 (l - 


16s + 60x 2 - 32x 3 + 4x 4 ) 






(1 - 24x + 136x 2 - 160x 3 + 16x 4 ) 




(4,4) 


(1- 


- x) 2 (l - 18x + 81x 2 - 81x 3 ) 2 (l - 27x + 


99x 2 - 9x 3 )(l - 9x + 18x 2 - 9x 3 ) 2 






(1 - 27x + 195x 2 - 361x 3 )(l - 6x + 9x 2 


-x 3 ) 2 (l-9x + 6x 2 -x 3 ) 2 



The polynomial Pkj(x) seems to have a lot of factors. We are grateful to Christian Krattenthaler 
for explaining equation Q12|) below, from which we can explain the factorization of Pk,j( x )- By an 
observation 13, §5] of Grabiner, gkj(n) is equal to the number of walks with n steps ±ej from 
(j, j — 1, . . . , 2, 1) to itself in the chamber j + k + 1 > x\ > x 2 > • • • > Xj > of the afflne Weyl 
group C n . Write m = j + k + 1. By p3 (23)] there follows 

3 



EQk n (n) -, — rr = det 



2m- 1 



— smtirra/m) sin(7rr6/m) • exp(2x cos(7rr/m)) 



r=0 



When this determinant is expanded, we obtain a linear combination of terms of the form 

Ex" 
2 n (cos(7rri/m) + • • • + cos(irrj /m)) n 



n>0 



n! 



(11) 
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where < r{ < 2m — 1 for 1 < i < j. In fact, the case rj = A of Grabiner's formula |131 (23)] shows 
that the number of walks of length n in the Weyl chamber from any integral point to itself is again 
a linear combination of terms 2 n (cos(7rri/m) + • • • + cos(-7rrj/m)) n . It follows that every eigenvalue 
of Akj has the form 

9 = 2(cos(-7rri/m) + • • • + cos(irrj /m)). (12) 

(In particular, the Galois group over Q of every irreducible factor of pkj(x) is abelian.) Note that a 
priori not every such 9 may be an eigenvalue, since it may appear with coefficient after the linear 
combinations are taken. The algebraic integer z = 2(cos(7rri/m) + • • • + cos(irrj/m)) lies in the 
field Q(cos(-7r/m)), an extension of Q of degree 4>(2m)/2, where 4> is the Euler phi-function. To see 
this, let z be a primitive 2m-th root of unity. Then z is a root of x + 1/x = 2 cos(7r/m). Hence the 
field L = Q(z) is quadratic or linear over K = Q(cos(-7r/m). Since K is real and L is not for m > 1, 
we cannot have K = L. Hence [L : K] = 2. Since [L : Q] = (j){2m), we have [K : Q] = 0(2m)/2. 
It follows that the minimal polynomial over Q of z has degree dividing 0(2m)/2. Thus every 
irreducible factor of det(/ — Ax) has degree dividing (p(2m)/2, explaining why Pkj(x) has many 
factors. A more careful analysis should yield more precise information about the factors of Pk,j(x), 
but we will not attempt such an analysis here. 

An interesting special case of determining pkj(x) is determining its degree, since the number 
of eigenvalues of A^j equal to is given by ( J ^ fe ) — 2 • deg Pk,j(x)- Equivalently, since A^j is a 
symmetric matrix, 2 • deg pk t j(x) = rank(Afcj). We have observed the following. 

1. For k + j < 12 and 1 < k < j, A^j is invertible exactly for (k,j) =(1, 1), (1,3), (1,5), (1,7), 
(1,9), (1,11), (3,3), (3,7), (3,9), (5,5) and (5,7). 

2. A\j is invertible if and only if j is odd. This is true because L(l,j) is a path of length j, 
whose determinant satisfies the recurrence det(Aij) = — det(Aij_2)- The statement follows 
from the initial conditions det(Ai j i) = —1 and det^i^) = 0. 

3. If A^j is invertible, then kj is odd. To see this, let Xq(Xi) be the set of integer partitions of 
even (odd) n whose shape fits in a k x j rectangle. Since L(k, j) is bipartite graph with vertex 
partition (Xq,Xi), a necessary condition for A^j to be invertible is |Ao| = That is, 
the generating function ^2 n p(k, j,n)q n = ( £ 3 ) must have a root at q = — 1, where p(k,j,n) 
is the number of integer partitions on n whose shape fits into a k x j rectangle. But the 
multiplicity of 1 + q in the Gaussian polynomial ( k j^) is — Lfj — L|J > which is unless 
both j and k are odd. 

Item 3 is also proved independently by Jason Burns, who also found a counterexample for the 
converse: For k = 3 and j = 11, ^3,11 is not invertible, in fact its corank is 6. The invertibility of 
Aj-j for kj being odd is currently under investigation. 
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